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In this brief report we explore the energy landscapes of two spin glass models using a greedy 
single-spin flipping process, Gmax. The ground-state energy density of the random maximum two- 
satisfiability problem is efficiently approached by Gmax. The achieved energy density e(t) decreases 
with the evolution time t as e(t) — e(oo) = h(log 10 t)~ z with a small prefactor h and a scaling 
coefficient z > 1 , indicating an energy landscape with deep and rugged funnel-shape regions. For 
the ± J Viana-Bray spin glass model, however, the greedy single-spin dynamics quickly gets trapped 
to a local minimal region of the energy landscape. 
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There arc extensively many competing interactions in a 
spin glass or a discrete combinatorial optimization prob- 
lem. These competing interactions cause strong frustra- 
tions among the spin values of different variables, leading 
to a complex energy landscape. The energy landscape 
structure has a fundamental influence on the equilibrium 
and dynamical properties of a thermodynamical system, 
and it has been extensively studied in the fields of pro- 
tein folding pQ and supercooled liquids [2]. But to work 
out the detailed energy landscapes for some representa- 
tive models has been very difficult, and numerical ap- 
proaches are limited to systems with 10 2 -10 3 particles 
(see, e.g., [31 H])- Some properties of the energy land- 
scapes of mean-field spin glasses were investigated using 
the replica and the cavity method of statistical mechan- 
ics [5]. These properties include (1) the energy level at 
which the equilibrium configuration space starts to split 
into exponentially many ergodic subspaces (referred to 
as Gibbs states), (2) the energy level at which a subex- 
ponential number of Gibbs states start to dominate the 
equilibrium configuration space, and (3) the ground-state 
energy density. But we know little about the distribution 
of minimal energies and the distribution of energy bar- 
rier heights [6]. Great efforts were devoted to the special 
case of the ground-states being unfrustrated, for which 
we enjoy a rather complete knowledge on the evolution 
of the ground-state configuration space [7llll|. Efficient 
stochastic search algorithms were designed to construct 
unfrustrated spin configurations (see, e.g., [7J [T2J [T3"]). 
Very recently, the cavity method of statistical physics 
was extended to study the evolution of a single Gibbs 
state with temperature [14] . 

In this brief report we explore the energy landscapes 
of two mean-field spin glass models using stochastic lo- 
cal dynamics. For the random maximum 2-satisfiability 
(Max-2-SAT) problem, we find that although the sys- 
tem is in the spin glass phase at low temperatures, its 
ground-state energy density (GSED) can be efficiently 
approached by a greedy (zero-temperature) single-spin 
flipping process Gmax. The achieved energy density e(t) 
by Gmax decreases with the evolution time t as e(i) = 



eo + h(\og w t)~ z , with a small prefactor h and a scaling 
coefficient z > I. The asymptotic value eo is extremely 
close to the lower bound of mean GSED as calculated 
by the first-step replica-symmetry-broken (1RSB) mean- 
field theory [15] . These results are quite surprising, as we 
anticipated that the ground-states of a spin glass system 
can only be approached by sophisticated processes (such 
as simulated annealing [16], exchange Monte Carlo [17j . 
extremal optimization |18j ) but not by a simple greedy 
local dynamics. The logarithmic decaying dynamics in- 
dicates that Gmax is exploring rugged funnel-shape re- 
gions of the energy landscape, whose bottom energy den- 
sities being very close to the ground-state energy density. 
Quite different dynamical behavior is observed for the 
±J Viana-Bray model, which is equivalent to a modi- 
fied random Max-2-SAT problem with short loops. This 
work suggests that the energy landscapes of different spin 
glass systems may have qualitatively different statistical 
properties. 

Max-2-SAT and Mean-field results. — A 2-SAT formula 
can be represented as a bipartite graph in which N binary 
variables i (with spin cr; = ±1) are constrained by M 
clauses a. Each clause a is connected to two variables 
(say i and j) by edges of fixed binary coupling constants 
J l a and J{; its energy is zero (clause satisfied) if Oj = J* 
or <Xj = J J a , otherwise its energy is unity (clause violated) . 
The total energy of a spin configuration {<Ji\ is 

^2sat(°V 02, ■ ■ ■ , ON) = 4 ■ UJ 

a=l 

The energy density is defined as the configuration energy 
divided by variable number N. Constructing spin con- 
figurations of the global minimum energy for this model 
(the Max- 2-SAT problem) is a NP-hard computational 
task (for work on approximate algorithms, see |19j and 
references therein) . We focus on the ensemble of random 
2-SAT formulas. In a random 2-SAT formula, the two 
direct neighbors of each clause are chosen uniformly at 
random from the N variables, and the quenched coupling 
J* between a clause a and a variable i takes ±1 values 
with equal probability. The ground-state energy density 
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FIG. 1: (Color online) Stability analysis on the T = 
1RSB mean-field theory for the random Max-2-SAT problem. 
yi and yu are, respectively, the type-I and type-II stability 
threshold for the reweighting parameter y. y* is the value of y 
at which the GSED is calculated. The 1RSB theory is stable 
at y = y* only if yu < y* < yi. The inset shows the spin 
glass transition temperature T s . 

of the random Max-2-SAT problem, as a function of the 
clause density a = M/N, can be estimated theoretically, 
giving us an opportunity to quantitatively measure the 
performance of a heuristic algorithm. 

A phase transition occurs for the random Max-2-SAT 
problem at a = 1, where the mean GSED starts to be 
positive. The system is then in the spin glass phase at low 
temperatures for a > 1. We have determined the spin 
glass transition temperature T s (a) using the 1RSB mean- 
field theory [20l [21] (see inset of Fig. [IJ . At temperature 
T = T s (a), the equilibrium configuration space divides 
into exponentially many Gibbs states. The mean GSED 
is calculated within the 1RSB theory by letting T = 
and weighting each Gibbs state by a factor e~ yE ~> , where 
E" 1 is the minimum energy of Gibbs state 7 and the 
reweighting parameter y is set to a particular value y = 
y* [15]. At each value of clause density a, the 1RSB 
mean-field theory has two stability thresholds yj and yjj 
[2"2l |2"5] ; for the mean-field theory to be stable at y = y* , 
it is required that yu < y* < yj. As we show in Fig. [T] 
this condition is violated at a > 1, suggesting that the 
GSED obtained by the 1RSB theory is a lower-bound of 
the true GSED [21]. 

Greedy single-spin flipping for Max-2-SAT. — A single- 
spin flipping process, Gmax, is used to construct low- 
energy spin configurations for single 2-SAT formulas. 
The process starts from a random initial spin configu- 
ration {<7j(0)} at evolution time t = 0. The evolution 
time then increases with step At = 1/N. A spin config- 
uration {o~i(t)} at time t is associated with a candidate 
variable set C(t). A variable belongs to C(t) if and only 
if reversing its spin does not cause an increase of the con- 
figuration energy. A variable i is chosen from the set C (t) 



FIG. 2: (Color online) The energy density reached by Gmax as 
a function of evolution time t. The energy trajectory is an av- 
eraging over 16 repeated running of Gmax on a single random 
2-SAT formulas of size N = 10 6 and a = 5.0. The solid line is 
the fitting curve of the form e(t) = eo + h/(lgt) z , with parame- 
ters (e ,h,z) being (0.433372(8), 0.005063(8), 1.375(7)). The 
asymptotic value eo is very close to the 1RSB lower bound 
of 0.43273. Inset shows two segments of a single evolution 
trajectory. 

uniformly at random, and at evolution time t' = t + At, 
the spin configuration is updated to {cj(i')} which differs 
from {o~i(t)} only at variable i. After this spin flipping, 
the candidate set is also updated to C(t'). 

Gmax is a greedy process, the configuration energy 
never increases with t. The density e(t) of energy at 
time t is e(t) = E{<Ji{t),<j2{t) 1 . . . , a^{t))/N. As an ex- 
ample, Fig. [2] shows the evolution of e(t) for a random 
2-SAT formula with N = 10 6 variables and clause density 
a = 5.0. We notice that initially e(t) decreases very fast 
with t. As t increases, the decreasing rate becomes slower 
and slower and the time interval between two consecu- 
tive energy decreases becomes longer and longer (inset of 
Fig. [2]). However, the energy of a single trajectory keeps 
decreasing even for t > 10 5 , suggesting that Gmax is not 
being trapped by a local energy minimum. The decreas- 
ing of e(t) can be well fitted by the following form 



with parameters eo, h, and z. The value eo is the asymp- 
totic value of e(t) at t — > 00, its value is slightly different 
for different random 2-SAT instances with the same N 
and a. The fitting parameter h ~ 10~ 3 is much smaller 
than eo, and the scaling exponent z is larger than unity. 
The observations, (i) e(t) can be expressed as a function 
of log(i), and (ii) the asymptotic value eo is very close to 
the 1RSB lower bound of the mean GSED, suggest that 
the random Max- 2-SAT problem has a funnel-shaped en- 
ergy landscape, to some extent similar to those of protein 
sequences [T]. Gmax visits different funnel-shaped regions 
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FIG. 3: (Color online) Comparison between the energy den- 
sity reached by a single run of Gmax on a random 2-SAT for- 
mula of N — 10 6 variables and aN clauses (crosses) and the 
1RSB lower bound of mean GSED (solid line). The inset 
shows the mean energy density reached by a single run of 
Gmax on 16 random 2-SAT formula of fixed clause density 
a = 5.0 (diamonds) and a — 10.0 (squares) and different 
variable numbers N, with the dashed lines marking the cor- 
responding 1RSB lower bounds. The waiting time of Gmax is 
set to t = 10 4 in all these simulations. 



when repeated on the same 2-SAT formula starting from 
different initial spin configurations, and the bottom en- 
ergies of these different funnels are very close to each 
other. However, if Gmax is made to be more greedy, e.g., 
by preferentially flipping those spins that lead to an en- 
ergy decrease, the modified dynamics is usually trapped 
by local minimal regions of the energy landscape. 

Figure [3] shows the energy density reached by a sin- 
gle run of Gmax at evolution time t = 10 4 on a random 
2-SAT formula of N = 10 6 variables and clause density 
a G [1, 10]. The simulation results are in excellent agree- 
ment with the energy density lower bound as obtained 
by the 1RSB mean-field theory, indicating that Gmax is 
able to approach the GSED of a large random 2-SAT for- 
mula within a reasonable waiting time. As a stochastic 
greedy local search process, Gmax is also very fast. We 
have compared the performance of Gmax with that of the 
message-passing algorithm SP-y on several large random 
2-SAT problem instances with N = 10 6 and a = 5 and 
a = 10. Gmax is about ten times faster than SP-y and 
it reaches noticeably lower energy values. The global al- 
gorithm SP-y is inspired by the 1RSB spin glass theory 
if contains several adjustable parameters, includ- 
ing the reweighting parameter y. As the 1RSB mean-field 
theory is not sufficient for the random 2-SAT problem, 
the message-passing routine of SP-y does not converge. 
One has to run the non-convergent SP-y process many 
times with different y values to get good results. The 
best results obtained by repeated running of SP-y are 
typically worse than the result of a single run of Gmax. 



FIG. 4: (Color online) Comparison between the energy den- 
sity reached by a single run of Gmax on a random 2-XORSAT 
formula of N = 10 6 variables and aN clauses (crosses) and 
the 1RSB lower bound of mean GSED (solid line). The inset 
shows the evolution trajectory of a single run of Gmax on a 
problem instance with N = 10 6 and a — 5.0. 

The inset of Fig.[3]shows the mean energy density value 
reached by a single run of Gmax at evolution time t = 10 4 
on random 2-SAT formulas of fixed clause density a and 
different sizes N. The reached energy density has only a 
tiny gap of about 0.002 above the 1RSB lower bound at 
t = 10 4 , and this gap does not increase with N. Such a 
tiny gap can be further reduced simply by waiting longer. 

Gmax for Viana-Bray model. — The ±J Viana-Bray 
model on random graphs is equivalent to the random 
2-exclusive-or-satisfiability (2-XORSAT) problem, its en- 
ergy function can be written as 

M j 

E^xorjci, Q~2, ■ ■ ■ )gjy) = /"] ° 1 3 ■ (3) 

a=l 

The coupling constant J a of a clause a takes ±1 val- 
ues with equal probability, and the involved two vari- 
ables i and j of a clause a are chosen from the whole set 
of N variables uniformly at random. The ground-state 
energy density of Eq. ([3| is positive at clause density 
a = M/N > 0.5. For a > 0.5, the random 2-XORSAT 
is in the spin glass phase at low temperatures. A lower 
bound for the GSED can be obtained using the zero- 
temperature 1RSB mean-field theory. 

Figure [4] compares the results of a single run of Gmax 
on a random 2-XORSAT formula with = 10 6 vari- 
ables and M — aN clauses and the energy density 1RSB 
lower bound. We notice that (see inset of Fig. [4]), Gmax 
quickly comes to a local minimum region of the energy 
landscape and it is then not able to escape. This is dra- 
matically different from the dynamical behavior observed 
for the random Max-2-SAT problem. There is a notice- 
able gap between the energy density reached by Gmax and 
the 1RSB lower-bound. 
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A 2-XORSAT constraint a can be expressed in terms 
of two 2-SAT constraints: (1 - J a o- i a J )/2 = (1 - <7i)(l + 
J a aj ) /4+ (1 +<Ti) ( 1 - J a aj ) /4. These two SAT constraints 
form a short loop between the two involved variables i 
and j. Therefore, a random 2-XORSAT formula with 
clause density a can be converted to a modified random 
2-SAT formula with clause density 2a. The GSED of the 
random 2-XORSAT problem at clause density a is only 
slightly higher than that of the random 2-SAT problem at 
clause density 2a (for example, according to the 1RSB 
mean-field theory, the GSED of random 2-XORSAT is 
1.320 at a = 5.0 and that of random 2-SAT is 1.307 at 
a = 10). The existence of an extensive number of short 
loops in the modified random 2-SAT problem therefore 
does not have much influence on the GSED. However, it 
changes the system's energy landscape significantly. 

Discussion. — The random Max-2-SAT problem is in 
the spin glass phase at low temperatures. However 
we found that, for single large Max-2-SAT problem in- 
stances, a simple greedy single-spin flipping process Gmax 
is able to reach spin configurations with energy densities 
extremely close to the lower bound of mean ground-state 
energy density as predicted by the 1RSB mean-field the- 
ory. Such an observation is contrary to the conventional 
belief that greedy dynamics will be trapped into local sta- 
ble regions of the energy landscape, whose energy densi- 
ties are markedly higher than the ground-state value [35] . 
From the logarithmic dependence of the energy density 
e(t) with the evolution time t [Eq. ([2])], we infer that, 
as the reached energy density is close to the asymptotic 
value eo, the configuration energy is further decreased 
by accumulating spin local modifications into configura- 
tion rearrangements of larger and larger scale pjj . This 



dynamical behavior is consistent with an energy land- 
scape with many rugged and deep funnel-shaped regions. 
On the other hand, the energy landscape of the Max-2- 
XORSAT problem (the Viana-Bray model) appears to 
have a very different structure. 

Our findings call for understanding from the theoreti- 
cal side. Gmax is simply a single-spin Glauber dynamics 
quenched at zero temperature. It is highly desirable to 
have a theoretical understanding on the empirical obser- 
vation Eq. pj). At the spin glass transition temperature 
T s , many Gibbs states start to form in the equilibrium 
configuration space. Suppose they are uniformly sam- 
pled, what is their energy depth distribution? And how 
will this distribution change if the Gibbs states at T s are 
sampled according to the Boltzmann distribution? The 
theoretical framework of [14] may be useful for answering 
these questions. 

For random Max-iGSAT problems with K > 3, our 
simulation results (not shown) suggest that Gmax is not 
able to find spin configurations with energy densities ex- 
tremely close to the IRSB-predicted ground-state value. 
However, the gap between the reached energy density 
and the ground-state energy density is still very small 
(for example, Gmax reaches an energy density of 0.3315 
at 10 4 evolution steps for a random 3-SAT formula of 10 6 
variables and a = 10, close to the GSED value of 0.3114 
by 1RSB theory; for a single random 4-SAT formula of 
10 6 variables and a = 20, these two energy densities are 
0.2960 versus 0.2493). 

This work was partially supported by NSFC Grants 
10774150, 10834014, and the 973-Program Grant 
2007CB935903. Simulations were performed on the HPC 
computer cluster of ITP-CAS. 
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